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ABSTRACT 

A systems approach to evaluation of the Diagnostic 
Reading Clinic Program's progress and its effects .upon participating 
pupils from the Cleveland schools is report^ on in this document. 
Formal evaluation of the Diagnostic Reading Ciinic Program is 
directed toward the following objectives: to ussess the extent to 
which the Diagnostic Reading Clinic has fulfilled its objectives; to 
describe, through objective measurement and statistical analysis, the 
amount of reading growth pupils have achieved through the 
diagnostic-prescriptive approach proposed by the clinic; to inform 
the clinic staff, administratioif^ school personnel, and other 
concerned audiences of the current status of the Diagnostic Reading 
Clinic's efforts with pupils; and to provide feedback to those who 
are directly concerned with the direction, management, planning, ^ 
implementation, and instructional operations of the clinic concerning 
implications which have resulted from the analysis of data collected 
for purposes of evaluation. (TS) 
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AN INTPRDISCIPLINARY APPROACH TO CORRPCFIVi: INSTRUCTION 

Part IV 

Monitorinr: Process anc)^ Assessing Product 



Formal evaluation of the Diaj^nostic Reading Clinic Program is 

directed toward the following objcGtives: 

To assess the extent to which the Dia(;nostic 
Reading Clinic has fulfilled its objectives. . 

To'describc, through objective measurement and 
statistical analysis, the amount of reading 
growth pupils have achieved through the diagnostic- 
prescriptive' appro:ich proposed by the Clinic. 

To inform Clinic staff, administration, school 
personnel and other concerned audiences of tluK 
current status of the Diagnostic [Reading Clinic's 
efforts with pupils. 

To provide feedback to those, who are directly 
concerned with the direction, management, plan- 
ning, ii.iplcitientation and instructional operations 
of the Clinic concerning implications which have 
resulted froin the analysis of data collected for 
purposes of evaluation. 

Monitoring and assessment procedures arc begun by trained 

clinicians under the direction of the Educational Program Manager, 

Mrs. Pauline Davis, at the time that the child is referred by the homo 

school. A "living pr:rile'* is generated as information is gathered on , 

each referred pupil. This rationale of input is reflected in the 

evaluation plan developed by Dr. Margaret Fleming in 1967. 



(Transparency: Rrlati onshi]) of Inputs Treatment, and 

Outlet Variable-*) In^.ert Chnrt I here, 

A more detailed explanation of the evaluation plan lists 

specific objectives, typei; of instruments to be used for data collection 

and the data analysis pioccsses. 



1. 
2. 

3. 

4. 
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In additioQ^ the criteria by whirh cjich objv'etivp is to 

/' 

be measured is stated, ^ 

' ^, , ^.^ . Insert Chart n ^,ore 

(Transparency: Plan for f.valuation) 

Comparison of achievement data showinp/^pre and post-prop,ram 
reading levels for each pupil with that pupil's reading expectancy, as 
established by the Bomi-Tinkcr Formula, is basic to the determination 
of that pupil's reading status at the given point in time. In 1971, we 
undertook a comparative study of the reading expectancies of 35 pupils 
using the Bond-Tinker, flarris and Los Angeles formula for the purpose 
of exai^ning our position in the choice of Formula. The Rcdenborn 
study, published in the Reading Teacher , Dtcombcr 1974, confirmed our 

"findings that in evaluation of the effectiveness of reading programs, 
the "Bond-Tinker formula provides a better estimate of the potential 

^ for pupiL=; who are r^'ferrcd to corrective reading pro^ramc. 

(Transparency: A Sample Computation of Reading 

Fsxpcctancy using the Bond-Tinker, 

Harris and Horn ['^^P^'L^illi— lDSffrI-Cb3Xt^ni 

Selection criteria for pupil participation in the Diagnostic 
Reading Clinic requires that pupils must be at least one year below 
grade level placement in reading. Their scholastic aptitude must be 
within the average and above average range. This information suf^gcsts 
that at the time of the pupil's admittance to the Diagnostic Reading 
Clinic, a decided deviation below expectancy has developed. The formula 
chosen for the Readinj', Fxpcctoncy would have to be orle which would be 
most approi)riate for the pgpil population which the Diagnostic Pending 
Clinic serves. 

A review of evaluation samples f ro:n 1968 through 1974 sl.owcd 
that 38.0 to 61 per ccjft of the pupils duiinu those yrars were two and 
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more years below their read in;', exjicctancies at the time that they were 
admitted to the Diagnostic Reading Clinic. "Within that same span of 
time, from 37 to 00 per cent of pupils achieved the criterion level with-- 
in one year and above their rending expectancies , post-prop,ram. 

Scores from the Gates MacHinitie Reading Tests, adrrinistered 
pre and post-treatnent, provide a measurement of a given pupil's silent 
reading power. Diagnostic asses^^ent with the Hates McKillop Diagnostic 
Reading Tests permits the identification of reading skills weaknesses 
wh^h are considered contributing aspects of reading performance levels 
suggestive of corrective prescriptive plans for the clinic:- 1 staff. 
Scholastic aptitude information, gathered from the pupil school records, 
is augmented with the IVcschler Intelligence Test for Children, adminis- 
tered by psychologists. Audiometric screening and testing by speecli 
therapists and health screening the clinic's nurse v.ith follow-up, 

arc vital parts of t)^e dia^nost'ic jn-o^^ross. hvaluation concerns itself 
with the objective data genera:. ed in this diagnostic process. These 
include: 

. scholastic aptitude scores from group 
tests 

individual assessment results from the 
IVeschler Intelligenco Scale for children 

. individual scores from the Stanford 
Binet Intelligence Test 

chronological age upon admittance to 
remediation 

. scores fro:i administration of the Gates 
McKillop Diagnostic l<cading Test 

. Gates MacCinitie Reading Test Scores 

Teachers indicate their assessment of the areas in which pupils 
have reading, difficulty at the tine of referral. The Division of Research 
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and Ucvclopiucnt requests a rating of indiviJual pupils' reading status 
and the degree of inprcvement in reading skills areas from'the classroom 
teacher on a five point rating scale at the time of \Jata collection. 
The scale attempts to obtain a description of the child's reading 
performance in the classroom in such areas as: 
. participatioti -n group reading 

• self-confidence in the reading 
process 

. mastery of reading assignments 

. general attitude toward^ school. 

Success indicators for pupils are. observed in: 

1. Changes in reading performance as indicated 
by scores on standardised reading tests and 
teachers' ratings. 

2. Changes in behavioral patterns dnvdlving 
reading performance and attitude toward 

c reading as indicated by teacher and parent 

observation. 

3. Changes in school achievement as indicated 
by school marks of participants. 

Sections of the evaluation are devoted to interpretations of 
the statis.tical analysis of results obtained through st^indarcjized testing. 
Summaries of the opinions of parents and teachers with accompanying rec- 
CQmmendations are included. 

The growth of the Diagnostic Reading Clinic is evident in the 
incrca.sjKg nnml)er of children it is serving. In 1967-68, the Diagnostic 
Clinic served 46S children. At the end of the 1973774 ypar, the Clinic 
had served 2,356 pupils from Cleveland schools, public and non-piihl i c. 
In contrast the cost of corrective instruction fiad decreased. 

One of the most fascinating aspects of the evahiation process 
is the emergence of implications for growth that arc generated through 
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objective data analysis. fJarly in the history of the clinic, evalua- 
tion results showed that patterns of flexible tine periods were needed 

4 

for improvement of pupil's reading f^rovvth. Reappearance of this pattern 
in the followinjr year's evaluation resulted in the establishment of J^ng, 
^ ^hort and node rate-t enii peri ods of i nst ruction . Assignment of pupils 

to these flexible periods of instruction is done by clinic staff. 
Fvaluation of units of gain is directly related to these specific groups 
based upon their periods of service. Comparisons of gains nade^by the 

\ 

\ various groups from year to year have clearly shown that the clinic has 

not served the sane pupil population from year to year. 

(Transparency: Average Grade Equivalent Gains 
, . By Long, Moderate and Short -"Term 

nrou{25l *«lL^5?r^.lrb2r^-IY 

Parents and teachers suggested the need for more service from 
the Clinic for more children in 1970. Clinic records showed that a full 
quota of children were being served. Communication through opinionnaires 
from teachers and parents revealed that a need existed for the provision 
of additional service fron the Clinic to nore pujnl?;. In 1972, two 
Satellite Clinic school-based centers were opened in schools v.hich were 
in close proximity to neighboring schools. The third Satellite Clinic 
Center opened on the West side of Cleveland in 1974 to servo a group of 
west side schools, relieving a transportation problem. 

Longitudinal studies of pupils' progress in later grades, after 
completion of their terms at the Clinio, icvealed a regresr-ion pattern 
for so::'e pupils after their return to classroom. It was recognized 
tiiat Kuiny pupils lose confidence in thi^ir roaJir.;t abilit/ once they havt.- 
moved fron the intinacy and concern of the clinic staff and it environs. 



ERLC 



, ^ AN' IKT. APP. TO COR. INSt. 

, * * MOX. PROC; A.\[) PROD: - Pajje 

» 

However, the readiiiR power they had derionstrated at the time of po^t- / 
treatment had been documented through the evaluation procesr,. Con^ 
tinuation of support for t)ic^e j)upils was indicated. In 1972, t\e 

Diaj;nostic Reading Clinic' implemented the Follow-up Clinic^ian component. 

\ 

A corp of Clinicians was :T5>.sip,ned tlic task of providing follow-up , 
services to children who had been clinic participants in their home \ 

schools, where lo^^istically feasible. During the 1973-74 school year \ 
eight Follow-up'Clinicians assisted 428 of tliese pupils. Analysis of \\^ 
their test scores showed that the mean standard score for this group was 
stanine five on the Gates MacGinitie Reading Test at the end of the year 
The reading power had been maintained. Periodically, we invite a team cf 
observers to view the Oiagnostic Reading Clinics' operational style and 
ask that they tell us, "How do you view the effects of this prcc'sr,?*' Arned 
with a locally constructed instrument, a schedule and a description of 
t\\c model, these observers spend some time at the clinic and its other 
components. In a debriefing session, they provide us with another as- 
pect of evaluation which we view as necessary and rewarding. Fach 
observer brings to the observation the strength of special areas, knowl- 
edge and experience. Their suggestions are often considered for future 
directions. 

Our approach to evaluation is a systems approach. V/orking with 
the Diagnostic Clinic, through our evaluation efforts, we seek to lend 
support in the planning, inplenentation, assessment, modification, and 
objective feedback stages, i.e attempt to identify strengths and' weaknesses, 
provide interpretations, report additional needs, record the history of 
the clinic's progress and document its effects upon participating pupils 
from the Cleveland scfiools. 
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AVERAGE GAINS IN GRADE EQUIVALENT UNITS 
IN COflPREUENSION 
DIAGNOSTIC READING CLINIC 



YFAR 




AVI- RAhF 

GAIN 
. ... .v.nlj,'... . 


Sf-RVIO Hi- R Kill 
1 11 1 lUn 1 no. 


1969-70 


LONG 


1.86 


5.00 




MODERATE 


1.51 


3.00 




QMORT 
onUK 1 


A! 
iDl 




1970-71 


LONG 


7.70 


^.50 




MODERATE 


3.70 


3.10 






7 ?n 


9 in 

Z 1 J u 


1971-72 


LONG 


11.57 


4.50 




MODERATE 


10.63 


3.75 




SHORT 


8.00 


2.00 


, 1972-73 


LONG 


16.60 


5.50 . 




MODERATE 


6.11 


3.63 




SHORT , 


7.00' 


2.60 


1973-7^ 


LONG 


5.00 


6.97 




MODERATE 


9.50 






SHORT 


7.81 


2.40 
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